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Chaotic itinerancy and power-law residence time distribution 
in stochastic dynamical system 
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To study a chaotic itinerant motion among varieties of ordered states, we propose a stochastic 
model based on the mechanism of chaotic itinerancy. The model consists of a random walk on 
a half-line, and a Markov chain with a transition probability matrix. To investigate the stability 
of attractor ruins in the model, we analyze the residence time distribution of orbits at attractor 
ruins. We show that the residence time distribution averaged by all attractor ruins is given by 
the superposition of (truncated) power-law distributions, if a basin of attraction for each attractor 
ruin has zero measure. To make sure of this result, we carry out a computer simulation for models 
showing chaotic itinerancy. We also discuss the fact that chaotic itinerancy does not occur in coupled 
Milnor attractor systems if the transition probability among attractor ruins can be represented as 
a Markov chain. 

PACS numbers: 05.45.-a, 05.40.Fb 



The concept of chaotic itinerancy (CI) was proposed 
as a universal class of dynamics with multiattractor, such 
as a chaotic itinerant motion among varieties of ordered 
states^, 0, 0- CI is generally described as follows: Dy- 
namical orbits are attracted to an ordered motion state, 
and stay there for a while. Subsequently they separate 
from the ordered state, and enter into high-dimensional 
chaotic motion. By those repetitions, they successively 
itinerate over ordered motion. Each of such ordered mo- 
tion states is called an "attractor ruin" . Showing mathe- 
matical properties of CI has become an important prob- 
lem in a variety of systems from many scientific disci- 
plines, including semiconductor physics, chemistry, ncu- 
roscience, and laser physics 0. 

To mathematically characterize CI, some researchers 
suggest that attractor ruins can be represented as Mil- 
nor attractors^, 0, 0, Q- A Milnor attractor is defined 
as a minimal invariant set that has a positive measure 
as its basin of attraction^. Since this definition does 
not exclude the possibility that the orbits leave from 
any neighborhood of the attractor, attractor ruins may 
be described with Milnor attractors. Indeed, in several 
models the existence of Milnor attractors with CI was 
reported^, 0, Q. However, it is still unclear whether 
Milnor attractors exist in a system whenever the system 
shows CI. 

The stability of attractor ruins is one of the important 
properties by which CI is characterized. Residence time 
distribution is regarded as the statistical property of such 
stability. In this paper we investigate the residence time 
distribution of orbits at attractor ruins, and discuss the 
possibility of CI that occur in a dynamical system con- 
taining Milnor attractors. To describe the distribution, 



we argue a mechanism of transition among attractor ru- 
ins, and we propose a model based on that mechanism. 

As an example of a dynamical system showing CI, we 
first review the globally coupled map (GCM)@| given by 



N 



x t+1 {i) = (1 - e)f(x t {i)) + - Y, f(MJ)), (i) 



N 
i=i 

where x t (i) is a real number, t is a discrete time step, i 
is the index for elements (i — 1,2, ■ ■ ■ , N = system size) 
and / is a map on R as the local element in Eq. . When 
the elements i and j are synchronized, i.e., x t (i) ~ x t (j), 
they are in a cluster. Each clement belongs to a cluster, 
including a cluster with one element. The state of GCM 
is characterized by a partition of elements into clusters. 
The state of partition is called clustering condition. CI 
of GCM is observed as chaotic changes of the clustering 
conditions^, Namely, in GCM a clustering condi- 
tion is the connotation of an attractor ruin. If elements 
of each cluster in a clustering condition completely syn- 
chronize, that is, Xt(i) = Xt(j) for any elements in one 
cluster, the clustering condition is an invariant subspace. 
Thus, CI of GCM is considered as a phenomenon that 
orbits approach an invariant subspace after staying in 
the neighborhood of another invariant subspace for some 
time. As an indicator of the stability of clustering condi- 
tions, the local splitting exponent A^[(i,n)^(| is defined 
by 



-, n+T 

1 n) = -j^log|(l- C )D/( a!m (*))|. (2) 

m—n 
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The local splitting exponent A^j^n) represents a local 
expansion rate of a separation distance between the el- 
ement i and an adjacent element of i. Thereby we can 
consider that A^pj(i,n) represents a local expansion rate 



2 



of a distance between two elements in the cluster to which 
the element i belongs. Indeed, the element i is contained 
in a cluster with more than one element if X^ pi (i,n) is 
negative, and the element does not synchronize with any 
other elements if X^ pl (i,n) is positive. Hence if the sign 
of A^j(i, n) switches, then a clustering condition changes. 
Moreover, if an orbit sufficiently approaches an invariant 
subspacc corresponding to a clustering condition, the lo- 
cal splitting exponent can describe the distance between 
the orbit and the invariant subspace by using a logarith- 
mic scale. 

In general, if the system is unstable in a direction nor- 
mal to an invariant subspace, an orbit leaves an attrac- 
tor ruin containing the invariant subspace. Note that 
the mechanism which destabilizes an invariant subspace 
is called a blowout bifurcation, and is known to cause 
bursts in on-off intermittencv|ll| . 

In summary, the mechanism of CI can be described as 
follows: 

• An orbit leaves an attractor ruin, when the distance 
between the orbit and an invariant subspace in the 
attractor ruin is greater than a certain value. 

• If nonlincarity, i.e., a local expansion rate, is weak 
in a direction normal to the invariant subspace, the 
distance between the orbit and the invariant sub- 
space decreases. Otherwise the distance increases. 

Based on the mechanism mentioned above, we intro- 
duce a prototype model in which CI occurs. We consider 
the distance between a orbit and the nearest invariant 
subspace. While in GCM the number of values for non- 
linearity, i.e., local splitting exponents, is equal to the 
system size, we consider only one variable to represent 
nonlincarity. Besides, the variable is a stochastic value 
of 1 or —1, and is decided by a probability associated with 
the nearest attractor ruin to the orbit. Furthermore, we 
introduce a probability to govern transition among at- 
tractor ruins. In definition of the transition probability, 
we assume that the influence of a past attractor ruin 
upon the transition decays rapidly, such that the tran- 
sition depends on only finite past attractor ruins. This 
assumption provides the simplest case as the chaotic itin- 
erant dynamics on attractor ruins in CI. 

We define a stochastic model satisfying the character- 
istics in the previous paragraph. Let n£N,i„e NU{0}, 
and y n = {1, ■•■ , M}. A series of positive integers 
{ x n}^=o is defined by 



X n +1 







= and e„ = 
otherwise, 



-1, 



(3) 



where e„ is a stochastic variable either 1 with probability 
Py-n or — 1 with 1 — p Vn . In other words, x n is given 
by a random walk on a half-line(see FigUa)). A series 
{yn} c ^Lo is also defined by 



Vn+l 



z„ otherwise, 



(4) 



where z n is a stochastic variable such as z n = k, with 
probability A Vn k being the element of a non- negative 
square matrix A. Namely, y n is determined by a 
Markov chain with the transition probability matrix 
A(see Fig^b)). Here y n is the index for attractor ru- 
ins, and e~ Xn is the distance from an invariant set corre- 
sponding to y n . In addition, p y denotes the intensity of 
nonlincarity on attractor ruin y, and Aij is the transition 
probability from attractor ruin i to j. 

In Fig[21 we display time series of x n and y n with re- 
spect to M = 100, Aij = jj, and Pi = 0.45 + /Xj where //j 
is a random number taken from [—0.05,0.05]. In FigEl 
we can see both the region where y n is fixed, and the 
region where y n is dynamically changed. Moreover, in 
the region where y n is fixed, x n is large, i.e., the orbit 
approaches the invariant set. 

Let us introduce the residence time distribution of or- 
bits at an attractor ruin in our model. The probability 
P(i,t) for residence time t at an attractor ruin i is given 
by the probability for i„ +i = if x n = 0, y n = i, and 
x n+k > for any k < t and n £ N. Since t is regarded as 
the recurrent time to origin in onc-dimcnsional random 
walk[T^.[T3j. this probability is given by 



P(i,t) = 



1-p 

bi(l-Pi)]" (2n 



t 



( 2 ™_- 2 ) 3neNt = 2n, (5) 







otherwise. 



If t = 2n and iigN, logP(i, 2n) can be denoted as 



logP(z,2n) 



dog[pi(l -pi)] - ilog (nn 2 (n - 1)) 



-(2n-2)log2 



(6) 



given by the approximate expression of Eq.(|SJ). If pi = 
0.5, then the right hand side of Eq.JfJJ takes the form of 
a constant plus the second term. Namely, the residence 
time at the attractor ruin i is governed by power-law dis- 
tribution. If pi < 0.5, then n in the first and third terms 
in Eq.© are not canceled, so that residence time distri- 
bution is truncated (see Fig[3J). The probability that the 
residence time at the attractor ruin i is longer than t is 
denoted by 



g(M) = i-jp(i,*)- 



(7) 



k=l 



It is easy to see that Q(i, 1) = p\ and Q(i,2n 
Q(i, 2n) for any neN. Since 
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then 











\4 2n - 






( 2 ;)i 


. V n — 







(8) 



Q(i,2n) - [l-4pi(l- Pi )]Y^ 



\pi(l-Pi)] 1 



k=l 



+Pt - 2p l (\ -p^ 



[Pi(l-Pi)]' 
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'2n^ 
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(9) 
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FIG. 1: Illustration of an itinerant dynamics model, (a) Schematic view of the space of x„. The stability of an attractor 
ruin is represented by a random walk on a half-line, where pi is a probability that a point moves to right on the half-line, 
i.e., x n +i = Xn + 1. If the point arrives on the leftmost address on the half-line, transition among attractor ruins happens, 
(b) Schematic view of the space of y„. Transition among attractor ruins is described by a Markov chain with a transition 
probability matrix A, where Aij is a probability moving from attractor ruin i to j, i.e., y n — i and y n +i = j- 
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FIG. 2: Time series of x n and y„. Here, M = 100, Aij = -j, 
and pi = 0.45 + [ii where fn is a random number taken from 
[-0.05,0.05]. 



Hence lim^oo Q(i, t) = if < 0.5, and 

limt-too Q(i,t) > if p,; > 0.5. Accordingly, while tran- 
sition from the attractor ruin i surely takes place when 
Pi < 0.5, transition does not necessarily take place when 
Pi > 0.5. 
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FIG. 3: The residence time distribution at the attractor ruin 
i with probability pi . 



Next, we investigate the residence time distribution 
averaged by all attractor ruins. In studying CI, the res- 
idence time distribution averaged by all attractor ruins 
is more useful than that of each attractor ruin. This is 
because the distribution of an individual attractor ruin 
can be studied only when the structure of the invariant 
sets is clear, but showing the structure is difficult in high- 
dimensional dynamical systems. 

To simplify the discussion here, we assume without 
loss of generality that transition probability matrix A is 
irreducible When the eigenvector associated with 
a positive maximum eigenvalue (which exists by the 
Perron- Frobenius theorem) is denoted as r, normaliza- 
tion of r denoted by q represents stationary distribution 
in a Markov chain with the transition probability matrix 
A. 

Suppose that pi < 0.5 for any 1 < i < M. Since 
transition from each attractor ruin always happens when 
the probability is one, orbits itinerate over all attractor 
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ruins. Hence the probability of residence time t for any 
attractor ruin is described by X)i=i QiP{ht) from prob- 
ability P(i,t) and stationary distribution q = {qi}^- 
Consequently, the residence time distribution averaged 
by all attractor ruins is the superposition of (truncated) 
power-law distributions. As a result, there is a case in 
which such distribution does not seem to follow power- 
law. In Fig^J we show examples of the residence time 
distribution with two attractor ruins. In the case of line 
(a), the residence time distribution follows power-law, 
since there exists a dominant attractor ruin (p 2 = 0.49 
and q 2 = 0.99). However, the residence time distribu- 
tion in the case of line (b) does not follow power-law. 
In this case, one attractor ruin rarely attracts orbits, 
but is stayed by the orbits for a long time (j>± = 0.49 
and qi = 0.01). Besides, another attractor ruin attracts 
frequently, but is stayed by the orbits for a short time 
(p2 = 0.25 and q 2 = 0.99). In this case the residence 
time distribution is multiscalc. 

On the other hand, if pi > 0.5, then the probability 
Qi = lhxif^oo Q(i,t) that transition at attractor ruin i 
never happens is a positive value. Since transition prob- 
ability matrix A is irreducible, the probability R that 
orbits itinerate over attractor ruins forever is given by 

M 

R= lim \Y q t (l - Q,)]" = 0. (10) 

i=l 

Thus, CI occurs only as a transient state in this case. 

1 ' '(a)pi=0.25,p 2 =6.49 ' 
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FIG. 4: The residence time distribution averaged by all at- 
tractor ruins for M = 2, qi — 0.01, and q2 = 0.99. The case 
of pi = 0.25 and p2 = 0.49 is shown by the solid line (a), and 
the case of pi = 0.49 and pi = 0.25 is drawn by the broken 
line (b). 

In the present paper, we have proposed the prototype 
model based on the CI mechanism. By analyzing the 
model, we have shown that the residence time distribu- 
tion averaged by all attractor ruins is the superposition 
of (truncated) power-law distributions. 

A computer simulation for GCM defined by Eq. Q was 
carried out to make sure of the result. Figure [5] displays 
the residence time distribution averaged by all clustering 



conditions in GCM with f(x) = 1 — ax 2 . This clearly 
shows that the residence time distribution in GCM fol- 
lows power-law as well as that in our model. Further- 
more, Fig|S{a) implies that orbits itinerate over attractor 
ruins having almost the same distribution, and Fig|BJb) 
implies with different distributions. 

As an another example of CI, we show dynamics of the 
kicked single rotor under the influence of noise [l4|. This 
dynamics is defined by the following two-dimensional 
map: 

x n+ i = x n + y n + S x (mod 2w), 

Vn+i = (l-v)y n + usin(x n + y n ) + 6 y , (11) 

where x corresponds to the phase, y corresponds to the 
angular velocity, the parameter v is the damping, and ui 
is the strength of the forcing. The terms 5 X and 5 y , where 

\J $x + 5y < 5, are the amplitude of the uniformly and in- 
dependently distributed noise. The dynamics of Ea. Hll|) 
is illustrated in Fig[(|] As seen in FigHJb), the orbit is at- 
tracted to certain ordered motion states for a while, and 
is kicked out of the states and behaves chaotically. Fig- 
ure [7| shows a result of a computer simulation of Eq. l(TT|) 
for the residence time distribution of orbits at attractor 
ruins. In this hgure, the residence time distribution aver- 
aged by all attractor ruins seems to be the superposition 
of truncated power-law distributions as well as the line 
(b) in Fig0] This hgure and our results imply that two 
attractor ruins with different residence time distributions 
exist in the dynamics of Ea. Hlfl . As the above experi- 
ment results show, theoretical results based on our model 
could be applied to other models showing CI. 

Let us consider our result by comparing the mecha- 
nism of temporal intermittency in low-dimensional dy- 
namical systems with that of CI. Temporal intermittency 
is a phenomenon that bursts sometimes appear in the in- 
tervals of ordered states, and is seen at some points in 
the parameter space in the neighborhood of bifurcation 
boundaries|l5j. Traditionally, researches of temporal in- 
termittency discuss the occurrence of bursts and their 
intervals, while CI researches discuss chaotic itinerant 
motions among several ordered states. Phenomcnolog- 
ically speaking temporal intermittency and CI share sev- 
eral features. For example, ordered states and chaotic 
states appear by turns. However, as discussed above, 
the mechanism of CI is different from that of classical 
temporal intermittency This difference a ppe ars as a dif- 
ference in the residence time distributions [lg. Thus, it is 
necessary to consider CI as distinct from those temporal 
intcrmittencies. 

In our model, if there is an attractor ruin i with 
Pi > 0.5, it has been shown that CI occurs only as a 
transient state. Note that pi > 0.5 implies that an at- 
tractor ruin i is a Milnor attractor, because a basin of 
attraction for the attractor ruin i has nonzero measure. 
Hence if there exists a Milnor attractor in our model, 
CI occurs only as a transient state. On the other hand, 
the existence of CI in a coupled Milnor attractor sys- 
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FIG. 5: The residence time distribution averaged by all clus- 
tering conditions in GCM for N = 10. In this simulation, 
elements i and j are synchronized if \x t (i) — xt{j)\ < 1CP 6 . 
(a)a = 1.57 and e = 0.3; (b)a = 1.9 and e = 0.2. 



tcm has been reportedQ. From the present result, we 
can consider the following two possibilities for CI in such 
systems: (a)thc behavior like CI is strictly observed as a 
transient, or (b)the transition probability among attrac- 
tor ruins cannot be represented as a Markov chain. If a 
system has a transition probability that cannot be repre- 
sented as a Markov chain, it is expected that the system 
is more complex than our model. Further analysis of such 
systems is required. 

Finally, to improve our model in future, we address 
ideas for extending it. In our model, the term of nonlin- 
earity has been simplified as either 1 or —1. This restric- 
tion is easily removed, but we believe that we will obtain 
the same results even if we study such a general case. As 
a more essential restriction, our model does not describe 
the concrete behavior of orbits on each attractor ruin. 
While this simplification allows us to investigate easily 
the relationship between the stability and the transition 
probability of attractor ruins, we cannot discuss the dy- 
namical behavior in each attractor ruin. One of the ex- 
tensions to express concrete behavior is that for any at- 
tractor ruins we prepare a function governing change of 
states. If dynamics on an attractor ruin is determined 
by a function associated with such attractor ruin, we 




4000 6000 
time 



8000 10000 



(b) 



10ji 




2000 



8000 



10000 



4000 6000 
time 

FIG. 6: An example of the time sequence described by Ea. l|ll|l 
with v = 0.02, ui = 3.5, and a = 0.15. (a)phase of the rotor 
x; (b) angular velocity y. 
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FIG. 7: The residence time distribution averaged by all at- 
tractor ruins given by Eq. llH with v = 0.02, u = 3.5, and 
a = 0.15. Here each region corresponding to an attractor ruin 
is given by (2n — l)n < y < (2n + l)n for each n£Z. 



can represent the concrete behavior on each attractor 
ruin. However, because orbits successively itinerate over 
attractor ruins, we must consider that the functions as- 
sociated with attractor ruins dynamically change. Func- 
tional shifts provide a framework to describe such dynam- 
ical systems [lg. A functional shift is defined as a shift 
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space that is a set of bi-infimtc sequences of some func- 
tions on a set of symbols. By using functional shifts, we 
can represent dynamical systems with dynamic change of 
functions. Improving the model proposed in this Letter 
by using functional shifts will be the topic of a future 



study. 

I am grateful to T. Hashimoto for useful discussions. 
I would like to thank J. Steeh for critical reading of the 
manuscript. 



[1] K. Ikeda, K. Otsuka, and K. Matsumoto, Prog. Theor. 

Phys. Suppl. 99 295-324 (1989) 
[2] K. Kaneko, Physica D 41 137-172 (1990) 
[3] I. Tsuda, World Futures: The Journal of General Evolu- 
tion 32 167-185 (1991) 
[4] K. Kaneko and I. Tsuda, Chaos 13 926-936 (2003) 
[5] K. Kaneko, Phys. Rev. Lett. 78 2736-2739 (1997) 
[6] K. Kaneko, Physica D 124 322-344 (1998) 
[7] I. Tsuda and T. Umemura, Chaos: An Interdisciplinary 

Journal of Nonlinear Science 13(3) 937-946 (2003) 
[8] J. Milnor, Commun. Math. Phys. 99 177-195 (1985) 
[9] K. Kaneko, Physica D 54 5-19 (1991) 
[10] K. Kaneko, Physica D 77 456-472 (1994) 
[11] E. Ott and J. C. Sommerer, Physics Letters A 188 39-47 
(1994) 

[12] W. Feller, An Introduction to Probability Theory and Its 
Applications, VOLUME 1, second edition, John Wiley & 
Sons (1957) 

[13] F. Spitzer, Principles of Random Walk, 2nd ed., New 



York, Springer- Verlag (1976) 

[14] S. Kraut, U. Feudel, and C. Grebogi, Phys. Rev. E 59 
5253-5260 (1999) 

[15] P. Berge et al., Order within Chaos: Towards a Deter- 
ministic Approach to Turbulence, John Wiley & Sons 
(1984) 

[16] J. Namikawa and T. Hashimoto, Nonlinearity 17 1317- 
1336 (2004) 

[17] A non-negative square matrix A is irreducible iff for any 
1 < i, j < M there exists n £ N such as A"j > 0, where 
A n is the nth power of A. 

[18] Temporal intermittency can be classified into so called 
type-I, II, and III. In type-I, maximum length of interval 
of bursts is given by e~ 1//2 , where e is a positive value. 
In type-II and type-Ill, probability distribution P(t) of 
interval of bursts is either P(T) ~ e~ 2eT if T > e _1 or 
P(T) ~ (4er)~ 3/2 if 1 < T < e _1 . 



